arXiv:1507.04354vl [hep-ph] 15Jul2015 


IPMU 15-0111 


Flavor-Changing Neutral-Current Decays in Top-Specific Variant 

Axion Model 

Cheng-Wei Cliiang, 1 ’ 2 ’ 3 ’ 4 ’^] Hajime Fukuda, 4, [j] 

Michihisa Takeuchi, 4 ’]*] and Tsutomn T. Yanagida 4 ’^ 

1 Center for Mathematics and Theoretical Physics and Department of Physics, 
National Central University, Taoyuan, Taiwan 32001, R.O.C. 

2 Institute of Physics, Academia Sinica, Taipei, Taiwan 11529, R.O.C. 

3 Physics Division, National Center for Theoretical 
Sciences, Hsinchu, Taiwan 30013, R.O.C. 

4 Kavli IPMU (WPI), UTIAS, The University of Tokyo, Kashiwa, Chiba 277-8583, Japan 

(Dated: July 17, 2015) 

Abstract 

The invisible variant axion model is very attractive as it is free from the domain wall problem. 
This model requires two Higgs doublets at the electroweak scale where one Higgs doublet carries 
a nonzero Peccei-Quinn (PQ) charge and the other is neutral under the PQ U(l) symmetry. We 
consider the most interesting and less constrained scenario of the variant axion model, where only 
the right-handed top quark is charged under the PQ symmetry and couples with the PQ-charged 
Higgs doublet. As a result, the top quark can decay to the observed standard-model-like Higgs 
boson h and the charm or up quark, t —> h c/u, which is testable soon at the LHC Run-II. 
Moreover, we propose a method to probe the chiral nature of the Higgs flavor-changing interaction 
using the angular distribution of t —> ch decays if a sufficient number of such events are observed. 
We also show that our model has the capacity to explain the h —> ry decay reported by the 
CMS Collaboration, if the right-handed tau lepton also carries a PQ charge and couples to the 
PQ-charged Higgs boson. 
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I. INTRODUCTION 


The strong CP problem can be elegantly solved by the Peccei-Quinn (PQ) mechanism [I], 
where a U(1)pq symmetry is employed to rotate away 6*q CD , the CP-violating phase in QCD. 
Not manifest in the standard model (SM), the PQ symmetry must be broken spontaneously, 
thereby predicting the existence of a Nambu-Goldstone boson. Since the PQ symmetry is 
anomalous, the additional light degree of freedom associated with the symmetry breaking 
is a massive pseudo Nambu-Goldstone boson, the axion M- Dynamics of the axion is 
characterized by the axion decay constant f a . The lower bound on f a is obtained from axion 
helioscopes and astronomical observations to be f a > 10 9 GeV (see, for example, Ref. [4]). 
Moreover, coherent oscillations of the axion field can play the role of cold dark matter 
in the present Universe [5H7], from which one determines f a ~ 10 n ~ 12 GeV [8j if axion is 
the dominant component of dark matter. This nice mechanism, however, suffers from the 
problem of domain wall formation in the early Universe. This is because the model has 
Ndw — 3 discrete vacua related to the number of families. 

The variant axion model introduced in Refs. p nm is an interesting axion model as 
it is free from the above-mentioned domain wall problem. This is achieved by allowing 
only one right-handed quark to carry a PQ charge and thus rendering a unique vacuum 
{Now = 1) HU- For consistency, the model requires two Higgs doublet fields, one of which is 
also charged under the PQ symmetry. As a result, there is a non-trivial flavor structure in the 
Yukawa couplings [12] that can lead to flavor-changing neutral-current (FCNC) couplings 1 
of the Higgs bosons to at least quarks. Besides, such FCNC couplings depend on the hclicity 
of fermions, that is not shared in common two-Higgs doublet models (2HDM’s). Therefore, 
it exhibits interesting flavor phenomena at low energies. 

In this work, we consider such a 2HDM with the PQ symmetry and assign a nonzero 
charge to the right-handed top quark, thus dubbed the top-specific variant axion model. 
In the model, Higgs-mediated FCNC couplings are generally present among the up-type 
quarks. Taking into account the current SM-like Higgs data and t —>■ ch branching ratio, we 
put constraints on the parameter space of the model. We then investigate the possibility of 

1 To be pedantic, Yukawa couplings involve no current in the conventional sense, and FCNC would be a 
misnomer. Nevertheless, we still use FCNC throughout the paper to emphasize the flavor-changing nature 
in the interactions mediated by the Higgs bosons between fermions of the same charge. 
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observing the t —>■ ch decay at the LHC. We also show how the helicity nature in the FCNC’s 
can be probed by studying the angular distribution of t —)■ ch decay. In view of the recent 
CMS observation of the h —» t/j, decay [T3] . we also study the scenario where a nonzero PQ 
charge is assigned to the right-handed tau lepton as well, and find that the observed data 
can be accommodated by the model. Moreover, such parameter space is within the probe 
of LHC Run-II on the t —> ch decay. 

This paper is organized as follows. Sec.|TT] discusses the structure of the Higgs sector 
along with the FCNC couplings of the SM-like Higgs boson to fermions. We study the 
current constraint on the mixing parameters in the Higgs sector in Sec. Ill In Sec. |IV[ we 
concentrate on the FCNC couplings in the up-type quark sector and examine in detail the 
t —>• ch decay, including its branching ratio and asymmetry in distribution. In Sec.|VJ we 
turn our attention to the FCNC couplings in the lepton sector and study the h —> t/j, decay. 


Discussions and conclusions are given in Sec. VI 


II. TOP-SPECIFIC VARIANT AXION MODEL 

As a minimal setup of the variant axion model, we introduce two Higgs doublet fields 
$1 and $2 and a scalar held a with PQ charges 0, —1 and 1, respectively. The gauge 
singlet scalar a gets a vacuum expectation value (VEV) f a and spontaneously breaks the 
PQ symmetry at a high energy scale. It therefore does not play much a role at low energies. 
In the quark sector, we assume that only the right-handed top quark held possesses a 
nonzero PQ charge of —1. Note that we can additionally assign nonzero PQ charges to 
leptons as well, as they do not contribute to the number of axionic domain walls Njjw HU- 
We discuss such a possibility toward the end of this section. 

Under the above PQ charge assignments, the most general renormalizable Higgs potential 
is, as given in Ref. El and following the notation and convention of Ref. E. 

V ( < f> 1 , $ 2 ) =m 2 u $\$i + m 2 22 $ f 2 $ 2 - (m 2 12 $ 1$ 2 + h.c.) + -j (V^) + y ($^ 2 ) 

+ A 3 ($^ 2 ) + A 4 (t|T 2 ) , (1) 

where the a held has been integrated out. The m\ 2 terms, as can be derived from the UV- 
complete Lagrangian E. softly violate the PQ symmetry. Moreover, through a rotation 
of PQ symmetry, m\ 2 can be made real and positive. All the other terms respect the PQ 
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symmetry and their associated parameters (m^, m| 2 , and Ai t 2 , 3 , 4 ) are real. 

After the electroweak symmetry breaking, each <f>j acquires a VEV z\ and can be written 
in terms of component fields as = ( H3~ , (ry + /r* + iA^)/\/2) T . We define tan/3 = v 2 /v\ 
as in the usual 2HDM’s and Ug M = vf + v 2 — 246 GeV. Rotating to the so-called Higgs 
basis [15], where only one of the doublets has a nonzero VEV, one has 




with R e = 


( cos 9 — sin 9 
sin 9 cos 9 


1 


with <f> SM = 


G + 

(wsm + h SM + iG 0 )/\/2 


<f>' = 


H+ ) 

(h' + iA 0 )/y/2j 


( 2 ) 

( 3 ) 


where G ± and G° are the would-be Nambu-Goldstone bosons eaten by the W ± and Z bosons. 
The pseudoscalar Higgs boson A 0 and charged Higgs boson H ± are mass eigenstates with 
masses and m H +, respectively. We also define the mass eigenstates of the CP-even 
neutral Higgs bosons as h and H } with respective masses rrih and (m^ < ran), using the 
rotation angle a as follows: 



= R-c 



— Rb- 


/3—a. 



( 4 ) 


Note that the light Higgs boson h becomes a SM-like Higgs boson h SM in the limit sin(/3 — 
a) —> 1, corresponding to the limit of m\ 2 —> oo. The couplings between h and weak gauge 
bosons are read as 


9hvv = sin(/3 - a)gf™ v , (Jhvv = cos(^ - a)g^ v , and g A vv = 0 , (5) 


where gf,y V are the couplings in the SM. Since the charged Higgs boson also contributes to 


the h —> 77 decay, to be considered in Sec.|III[ we provide the triple Higgs coupling A hh+h-, 
defined by the A hH+H-hH + H~ interaction in the Lagrangian, here: 

1 - \{rn 2 h + 2 m 2 H+ — 2 m 2 A ) sin(/3 — a) 

( 6 ) 


A hH+H - 


^SM 


+{m 2 A + m 2 h ) (tan (3 — cot /3) cos(/3 — a)] , 


where m 2 A = 2 m\ 2 l sin 2/3. 

We next investigate the Yukawa interactions. Here we explicitly work out the result in 
the up-type quark sector because of the assumption that only the right-handed top quark 
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has a nonzero PQ charge among all quark fields. Nevertheless, the same can be done to the 
down-type quark sector and the lepton sector if necessary [12]. First, the up-type Yukawa 
Lagrangian is 


Y" — — &lURa{Yul]aiQi — $2UR3{Y u 2]iQi + ll.C. 

= -^URilY^Qj - &u m \YXQi + h - c - > 


(7) 


where the first line is written in the original basis and the second line in the Higgs basis, 
and the family indices run a = 1,2 and i,j = 1,2,3. The Yukawa coupling matrices, Y ul 
and Y u2 , take the following forms: 


( 8 ) 



* * * 


0 0 0 

Y ul = 

* * * 

, = 

0 0 0 


,0 0 o y 


. * * * , 


where * indicates a generally nonzero element. As a result, 
Y^ M = cos /3Y ui + sin [3Y u - 2 , 


Y' u — — sin f3Y ul + cos /3Y u2 = 


( 


\ 


■ tan 


— tan /3 


cot 


\ 


P) 


Y 


SM 


(9) 


At this stage, the mass matrix M u = ^^Y U SM is generally non-diagonal, and can be brought 
to such a form through a bi-unitary transformation VM U U ^ = cliag (rn u ,m c ,mt) = ■^HJ iiag , 
where U and V are two unitarity matrices. In this basis, the other Yukawa matrix 


/ 


Y 1 ’ dia s — 


— tan f3 


\ 


tan (3 


V 


Y u diag + (tan 0 + cot P)H U Y*^, 


( 10 ) 


where the Hermitian matrix 


X 

cot P j 




f° ^ 


f° 1 

H u = V 

0 

Y t - 

0 


V 


V 


( 11 ) 


Note that in the second term of Eq. (10), the (tan/3 + cot P)H U part describes the mixing 
among up-type quarks and Y u dia s controls the strength of coupling with the dominant compo¬ 
nent given by the top Yukawa coupling. From simplicity, we will omit the superscript “diag” 
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while working in the mass-diagonal basis from now on. Note that V is the rotation matrix 
for the right-handed quarks and is completely independent of the CKM matrix, which is 
the product of left-handed up-type and down-type quark rotation matrices. Therefore, the 
mixing angles in V can be as large as 0(1), a key feature of the model. 

In the following, we focus exclusively on the Yukawa interactions of the observed Higgs 
boson, h. In the mass eigenbasis, 



A'— y\ if ^/z+^fcnc 

, ^ , ^SM 

J=e,-" ,w,-” ,d ,••• 


(12) 


with £ FCN c = a Y] (. H u ) ff/ f hf R f L + h.c. , 

, ,, , ^SM 

f,f'=u,c,t 

(13) 

where 

1 sin(/3 — a) + cot (3 cos (f3 — a) 
if = \ 

1 sin(/3 — a) — tan f3 cos (/3 — a) 

(for f=t) 

(for / ^ t) 

(14) 


a = (tan (3 + cot f3) cos (j3 — a) . 


(15) 


We note in passing that there is a freedom to make the right-handed tau lepton like the 
right-handed top quark or the bottom quark; i.e., £ r = or It should be emphasized 


that £fcnc hi Eq. (13) contains not only FCNC terms, but also flavor-diagonal Yukawa 
interactions so that the corresponding up-type quark Yukawa couplings get modified from 


those in Eq. (12) with nonvanishing a and H u . Obviously, the flavor-violating effects vanish 
in the limit of cos(/3 — a) = 0. 

One striking feature of £fcnc is that flavor violation is associated with large asymmetries 


in chirality. One can see this as follows: the hfnf' L coupling is expressed as (. H u )fft ^ while 
the hf' R f L coupling is (. H u )f/f Since H u is Hermitian, we have (H u )fft = (H u )*^j. 
Therefore, there is a disparity between the two couplings according to the mass hierarchy 
in / and f. In other words, the two chiral states of the fermion / have different Yukawa 
couplings strength with the fermion f in the opposite chiralities. 

As an illustration and in anticipation of interesting collider phenomenology associated 
with the top quark, we restrict ourselves to the case of t-c mixing in this paper. The 
extension to general three-generation mixing is straightforward. In such a simplified scenario, 
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the mixing matrix H u can be parameterized as: 


/r 


H u = — 
2 


0 0 0 
0 1 — cos p sin p( cos 0 — i sin 0) 

y0 sin p(cos 0 + i sin 0) cos p — 1 

where the mixing angle p is defined by 


\ 


( 16 ) 


1/ = 


0 


0 


\ 


cos | 


sin p e *7 


0 — sin p cos £ 


2 / 


In this paper we do not consider any CP-violating effects and set 0 to zero for simplicity. 
Therefore, the flavor mixing phenomena are described solely by the parameter p. The 


relevant FCNC terms in Eq. (13) are 


£tc — 


c L 


a , ( _\ I m c (l — cosp) m t sin p 

9 ( c r tji J I II | + h.c.. 

zfsM v ' \ rn c sin p m t (cosp — 1 )) \tL 


After redefining to include the diagonal terms in the above expression, Eq. (14) becomes 
3in(/J — a) + (cot f3 — 1- ^ osp (tan (3 + cot 0)) cos(0 — a) (for / = t) , 


tf=< 


sin(0 — a) — (tan/3 — 1 /(^ (tan/j + cot 0)) cos(/3 — a) (for / = c) , (17) 

sin(/3 — a) — tan j3 cos(0 — a) (for the others) . 


These results reduce to Eq. (14) by taking the mixing angle p = 0. 


So far, we have assumed that the lepton sector is not charged under the PQ symmetry, 
as for the down-type quark sector. As alluded to earlier, we have the freedom to assign 
nonzero PQ charges to leptons without causing any problem. As an example, we consider 
the scenario where only the right-handed tau lepton among the leptons also carries a PQ 
charge of +1. Then we expect a flavor structure similar to the up-type quark sector, and 
£fcnc now should also include the leptonic part: 


^fcnc — a ^ hf R f L + h..c. ) 

, ,, nsM 

t T' —f> II T 


(18) 


where Hi is the counterpart of H u . Clearly, this Lagrangian describes lepton flavor viola¬ 
tion with the chirality asymmetry as in the up-type quark sector. One can use the same 
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parametrization as in Eq. (16), with the mixing matrix V e in the lepton sector rotating the 
right-handed r and p. Note that the rotation angle p T can be different from p in general. We 
consider only the CP-conserving case (i.e., the corresponding leptonic CP-violating phase 
(f) T = 0) in this paper as well. Eq. © can be correspondingly tailored for the leptons and 
have £ r = and = £ c with the replacement p —> p T . 


III. CURRENT HIGGS DATA AND CONSTRAINTS 

In this section, we use the latest LHC Higgs data to constrain the model parameters, 
the angles a, /3 and p in particular. As noted earlier, the couplings between the SM-like 
Higgs boson h and the SM particles are modified from their SM values: Eq. (J5]) for the 
gauge bosons and Eq. © for the fermions. We use them to estimate the signal strengths 
of various Higgs production channels. 

In our global y 2 fit, we take into account the signal strengths listed in Table [IJ as reported 
by the ATLAS and CMS Collaborations in Refs. [16 ; ;TTj. When there are asymmetric errors, 
we take their average for the y 2 function. 

Observable ATLAS [16] CMS [17] 


hi 

1 7+0.5 

1 * ' —0.4 

O qqq+0.336 

U.ooo_q 272 

Vww 

0-98+1 

0 7fifi+ 0 - 228 
U. <00_o 2 05 

^ww 

i no+0.55 
l ' Z °-0A7 

0 R23 +0 ' 593 
u.uzo_ 0 479 

GGF 

1.32 ±0.38 

1 QQ7+0.293 
i - uu ‘ -0.259 

/4 H 

0.52 ±0.40 

l-008+i 2 9 7 

GGF 

i TT 

2.01+ 

0-843+;^ 

m VBF 

rTT 

L24 -a54 

0.948+;^ 


TABLE I: Signal strengths of various modes measured at LHC mm- In the first column, the 
superscript GGF, VBF, or VH refers to the production mechanism gluon-gluon fusion, vector boson 
fusion, or associated production, respectively, and the subscript indicates the channel. 

Among the channels listed in Table [T| the diphoton channel is the only mode sensitive 
to heavy Higgs boson masses though the loop contribution of the charged Higgs boson. 
However, in comparison with the SM top and W loop contributions, the charged Higgs 








loop is less important because the scalar loop function is generally smaller. For example, 
taking M = tua = rriH+ — tuh in Eq. i§. we find that the result is virtually independent 
of the choices of M when it is above 200 GeV. It is also possible to arrange a significant 
cancellation in the coefficient of the sin(/3 — a) term in Eq. We have checked in a 

reasonable parameter space that adding the charged Higgs contribution does not modify our 
final results much. Therefore, we show in the following the results for A hH+H- — 0. 

50 
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-0.5 0.0 0.5 1.0 1.5 2.0 2.5 3.0 

a=(tan /3 + cot /3)*cos(/3-a) 

FIG. 1: Allowed parameter space at 68% (dark blue), 95% (blue) and 99% (light blue) CL on the 
a-tan [3 plane. Here we assume £ r = £* and = £ c , and the mixing angle p = 0. 

Fig.[l]shows the allowed parameter space on the a-tan (3 plane of our model, as constrained 
by the current 125-GeV Higgs data when the flavor mixing effect is switched off (p = 
0). There are two branches of allowed space: a ~ 0 and a ~ 2.2. In either branch, the 
parameter region has little dependence on tan/3 once it become sufficiently large. In fact, 
this independence does not only occur to the p = 0 case, but also manifests when p is finite. 
At 95% confidence level (CL), the branch of a ~ 0 is constrained to have |a| 0.2. The 

other branch corresponds to the so-called wrong-sign Yukawa region [18], where the Yukawa 
couplings of quarks other than the top have an opposite sign to their SM ones. In the 
following, we will assume large tan /3 > 10 and consider both branches. 

Next, we consider finite flavor mixing effects described by a non-zero p. As noted above, 
the allowed parameter space has little dependence on tan /3 when it is > 10, we therefore fix 
its value at 10 in the following numerical analysis. Fig. [2] shows the allowed parameter space 
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Q. 



-0.5 0.0 0.5 1.0 1.5 2.0 2.5 3.0 

a=(tan p + cot /3)*cos(/3-a) 



FIG. 2: Allowed parameter space at 68% (dark blue), 95% (blue) and 99% (light blue) CL on the 
a-p plane. The left (right) plot is drawn for the t lepton with a Yukawa coupling scaling factor £ r 
as the bottom (top) quark. Constraints from the current t —> ch branching ratio bound at 95% 
CL are also superimposed in pink. The future 95% CL sensitivity on the t —>• ch branching ratio 
is drawn in red. In the right plot, the parameter regions consistent with the CMS h —> rp at 68% 
(green) and 95% (light green) CL are also overlaid for comparison. 

on the a-p plane. Here, we consider two scenarios: £ r = £& (left plot) and £ T = (right 
plot), corresponding to the PQ charge of r lepton being 0 and 1, respectively. Moreover, 
the mixing angle p T = p is assumed in the latter scenario. As is expected from Fig.[lJ we 
find two allowed regions: a ~ 0 and a ~ 2. The former corresponds to the decoupling limit, 
and the latter to the wrong-sign Yukawa limit. A common feature in both plots is that the 
allowed range for a ~ 0 is more stringent when p ~ 0, ±7r and more relaxed when p ~ ±7t/2. 

The region a ~ 2 has cos p > 0.85 in both plots, with the £ r = £ t scenario having a slightly 
larger allowed space. Moreover, the scaling factor of the bottom Yukawa coupling £& ~ —1.2, 
having an opposite sign from its SM value. This sign change results in an increase of ~ 30% 
in the GGF production cross section due to the interference between the top loop and the 
bottom loop appearing in the effective ggh coupling, which cancels with the decrease of the 
branching ratios due to the increase of the total width to maintain /i GGF, s almost unchanged. 
Since currently the most constraining data come from the GGF production channels, we find 
it particularly important to measure the signal strengths p^. FF and p™ to a better precision 
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in order to probe this large-a region. 

As will be discussed in detail in the next section, data of FCNC processes can put useful 
constraints on the parameter space as well. Such FCNC effects are proportional to a 2 sin 2 p. 
In Fig. [2j we overlay the regions allowed by current (pink) and future (red) top FCNC 
measurements. As one can see, a large portion of the large-a region is excluded by such 
data already. The anticipated sensitivity of the 14-TeV LHC with 3000 Ru 1 will further 
constrain the large-a region as well as the a ~ 0 region with p % 0, ± 7 r. 

Finally, also shown in the right plot of Fig. [2] are the parameter regions consistent with 
BR {h —> r/r) reported by the CMS Collaboration, the details of which will be discussed in 
Section |Vj The parameter space consistent with the Higgs data and the h —> r/i excess at 
the 2cr level is found in the regions with |a| ~ ±0.3 and p ~ ±7t/ 2 and in part of the large-a 
region. Interestingly, these regions are only marginal in view of the current top FCNC bound 
and within the reach of LHC Run-II experiment. 

IV. TOP QUARK FCNC INTERACTIONS 

This model generically predicts the top FCNC decay t —> ch (or t —>■ uh) via the mixing, 
serving as a smoking gun signature. For definiteness, we only refer to t —> ch in this section, 
but note that basically current experimental limits do not tag the flavor of the accompanied 
jet and what is constrained is the sum of all branching ratios of t —)■ qh. 

At the LHC, one can use photon channel and multi-lepton channels to search for t —>■ ch 
in top pair production, he., pp —> tt —> ( Mv)(ch) with h —> WW/ZZ/rf [19j. Both ATLAS 
using h —>■ 77 channel (7-TeV and 8 -TeV) [20] and CMS through inclusive multi-lepton 
channels ( 8 -TeV with 19.5 fb -1 ) [2TJ searched for t —)■ ch and set the upper bounds on the 
branching ratio of 0.79% and 1.3%, respectively, which correspond to \/|A te | 2 ± |A c£ | 2 < 0.17 
and < 0.21, where A tc and Aare the flavor-changing Yukawa coupling appearing in the 
interaction Lagrangian, —(At c^rCl + A c tCntL)h+ h.c. CMS further improved its limit by 
adding the leptons ± di-photon channel in the same event set as above, and obtained the 
constraint BR(t —> ch) < 0.56% at 95% CL, corresponding to 7 /1A tc | 2 ± |A ct | 2 < 0.14 [22] 23]. 

In the future LHC run, the limits on BR(f —>■ ch) will be greatly improved, with the 
expectation of 2 x 10~ 3 (300 fb _1 ) or 5 x 10 -4 (3000 ftr 1 ) in the lepton channels and 
5 x 10~ 4 (300 ftv 1 ) or 2 x 10~ 4 (3000 fb -1 ) in the photon channels f241426j . Note that these 
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numbers are estimated simply by scaling up the cross sections without optimizations of the 
analysis. Therefore, better bounds in reality are anticipated. A more optimistic study [27] 
predicts a branching ratio of 5.8 x 10 -5 as the 3a discovery limits with 100 fb _1 using the 
h —)• bb mode. One can also probe the same coupling using the single top and h associated 
production: ug —» th and eg —)■ th. However, the sensitivity of such processes at the LHC is 
usually weaker than the rare top decay search. 

It is noted that the h-t-c/u coupling can also contribute to other flavor observables. 
For example, imaginary parts of the flavor-violating Yukawa couplings are constrained by 
the hadronic electric dipole moments, CP-violating observables in the D- 11 leson sector, and 
D -meson mixing [28j . 


A. Signal rate 


Using the parameters defined in Section[TT| one can compute the decay amplitudes M.h t ,h c 
as follows: 


M +i+ = 


m t a sm p 
2v 


6 


\J 2 m t E 3 cos-, M .-.|_ 


m t a sm p 


6 


2v y/2m t E 3 sin-, M± = 0, (19) 


where the subscripts h t and h c (= + or —) denote the spin direction of the top quark and the 
helieity of the charm quark, respectively. The angle 6 is defined as the charm momentum 
direction relative to the top spin direction in the top rest frame. We have neglected the term 
proportional to m c compared to rrit and, as a result, the amplitude involving the left-handed 
charm quark is vanishing. 

The partial decay width of t —>■ ch is computed as 


G F m 3 a 2 sin 2 p 2 2 
T t^rh = --(1 - r h ) , 




, m+ ( ml — ml 

with E 3 = --[l - 

• ' mf 


yyi* 

and ri = —| ~ 0.522 , 
m 2 t 


( 20 ) 


where we take = 125 GeV and mt = 173 GeV. We can obtain the branching ratio 
by comparing it with the width of t —> bW in the SM at the leading order, 2 assuming 


2 It is known that QCD corrections at next-to-leading order result in an 0(10%) reduction in the partial 
width of t —y bW [29]. For consistency, however, we use the Born widths for both t —> bW and t —► ch to 
evaluate the branching ratio of the latter. Even if the QCD corrections are included, they should roughly 
cancel out in the branching ratio. 
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BR (t —> bW ) is close to unity: 

_ G F \Vtb\ 2 mf 2 N2/T , o 2 \ 
t 1 Tw ^ ’ 

where r 2 v = m^/mf ~ 0.214. That is, 

br(( ch) = 8(i-r^ri+U)i^i 2 “ 2 si " 2 p " (3 - 24 x io ~ v sni2 P ■ (21) 

The current branching ratio limit of 0.56 % constrains the mixing parameter as 

a 2 sin 2 p < 0.17 . 

The future sensitivity of BR(t —> ch) < 2 x 10 -4 (14 TeV and 3000 fb~ 4 ) will set the limit 

a 2 sin 2 p <6.2 x 10 -3 . 

Such constraints have been overlaid in Fig. [2] by the pink and red regions, respectively. 


B. Decay distribution 


Once we observe enough t —s- ch events, it will be possible to check the chiral property 
in the flavor-changing coupling as predicted in the model, namely, the charm quark in the 
decay product should be right-handed. For this purpose, we can make use of the hclicity 


amplitudes of top decay in Eq. (19) once we know the top spin direction. The spin analyzing 
power Ki of the decay product i is defined as 


1 dTj 
T i d cos 9i 


1 

2 


(1 + KiP COS 9i) , 


( 22 ) 


where P is the polarization of the decaying particle along a certain direction, T,; is the partial 
decay width into the decay product i, and d* is the polar direction of the decay product i 
relative to the polarization axis. The spin analyzing power of the charged lepton Kf+ from 
the usual top decay t —> b£ + is is known to have largest value +1 at leading order [3U] , Our 
model predicts dT t ^ ch /dcos9 oc 1 + cosR Therefore, the charm quark and the Higgs boson 
have the spin analyzing powers n c = +1 and Kh = —1, respectively. We denote the spin 
analyzing power for the anti-top with R and note that Rj = —Kf assuming CP invariance. 

The net polarization of the top quark is zero in the top pair production at the LHC. Still, 
we can use either tt spin correlation or single top production as the source of initial top spin 
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polarization. As the spin analyzing power for charm (or Higgs) has a maximal value in the 
model, we expect that the spin-correlation analysis using the di-lepton channel in top pair 
production at the LHC [21) 32] should work similarly using the lepton + di-photon channel 
from tt —> ( bl + u)(ch ) or ( b£~P)(ch ). Moreover, this channel involves only one neutrino as the 
source of missing momentum and, therefore, one can completely solve the event kinematics 
using top and W mass shell conditions. 

At the LHC, using the helicity basis is known to be a reasonably good spin quantization 
axis to probe the spin correlation effect [23] . The asymmetry defined by 

A = AT (hh) + N (hk) - N mh) - N (hh) 

hel N(t&) + N(t&) + N (b|-ijj + N(t&) 1 J 

is predicted to have a value ~ 0.35. This asymmetry shows up in the double theta distribu¬ 
tion: 


1 da 
a d cos 6id cos 9j 


- (1 + A he i Kihij cos 9i cos 9j ) , 


(24) 


where 9 tJ are dehned in the rest frame of top and anti-top quark, respectively. We can 
determine Hh (or k , c ) by measuring the distribution for i = £ + , j = h and for the correspond¬ 
ing anti-particle case. We expect that the distributions of cos 9g+ cos 9h and cos 9^- cos 9h 
should be identical due to the relation Ki+Rh = Re-Kh- Therefore, we simply use the nota¬ 
tion cos 9g cos 9h in the following. Fig. [3] shows the expected distribution of cos 9g cos 9h for 
Kh = ±1,0 cases. One can obtain the coefficient A he i H(+Rh by determining the mean value 
of the quantity under this distribution: 


(cos 9 1 cos 9h) 


Ahel l^h 

9 


(25) 


In our model, Kh = — Rh = —1 gives a positive mean value of ~ 0.039. 

Finally, we provide a rough estimate for the sensitivity based on a simpler observable 
instead, and leave the detailed study to a future work. Let’s introduce the asymmetry 

_ N(cos9 e cos9 h > 0) - N(cos9 e cos9 h < 0) _ A hd K e +R h 

Ach ~ N(cos 9e cos > 0) ± A^(cos 9t cos 9 h < 0) “ 4 °-° 88 ^' (26) 

To confirm Kh ~ —1, we have to measure A^ with a precision better than 0.088. The 

statistical uncertainty on is given by 


A A^ — A N/N ~ 1/VN > 0.088 , 


(27) 
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=-1 (our model) 
=1 



FIG. 3: Expected cos Of cos distributions for = —l(our model), 0 and +1. 

which implies that we need at least 130 signal events to confirm the decay distribution 
structure at la level. This simple estimate does not include background estimates. However, 
with a(tt) ~ 1 nb at the 14-TeV LHC and an integrated luminosity of 3000 fb 1 , we expect 
3 x 10 9 top pair events. It provides ~ 10 6 t —> ch events if BR (t —* ch ) = 2 x 10 -4 , 
a conservative sensitivity that LHC can reach. Even after multiplying BR(h —y 77 ) ~ 
2.3 x ICC 3 and the leptonic decay branching ratio of the top quark, we still expect ~ 500 
events. Besides, the h —> bb mode can be incorporated to enhance the number of events m 

V. LEPTON FCNC INTERACTIONS AND h -> 771 DECAY 

As we have shown in Section[TTJ the Higgs boson can have lepton flavor-changing Yukawa 
couplings if the right-handed tr carries a nonzero PQ charge. In this section, we discuss 
the lepton FCNC interactions and the corresponding constraints. The CMS Collaboration 
recently reported a measurement of the flavor-violating decay h —> t/i [T3] . The observed 
branching ratio for this decay mode 

BR obs (/r /it) = ^° bs = (0.84+ 9 ; 3 ?) % , (28) 

L A a sm 

where Yobs denotes the number of observed events, £, A and ctsm are the integrated lumi¬ 
nosity, the acceptance of the selection cuts, and the total production cross section in the 
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SM, respectively. To relate this quantity to our model, we have to including a correction 
factor in the production cross section: 


BRobs (h /jt) = BR VA (h ~ £ s 2 BR V a(^ -> pr), 

C^SM 


(29) 


where is the ggh coupling scale factor in our model relative to the SM one and we have 
assumed that the production is dominated by the GGF mechanism. The VBF mechanism 
also partly contributes to the cross section. We have checked that including the VBF 
production would infer a smaller value of a to explain the signal. Our result above is thus 
considered as a more conservative estimate. 

The branching ratio in the model is found to be 


BRva(/i —> pr) ~ 


a 2 sin 2 p T 


(30) 


36.52& 2 + 14.64 sin 2 (/3 - a) + 6.44f s 2 + 4£ r 2 ’ 
where we have included only the h —> bb, WW *, ZZ*, gg and rr decays in the denominator 

Therefore, we obtain for £’s ~ 1 that 


a 2 sin 2 p T ~ 0.35, 


(31) 


in order to explain the observed h —> r/i events. We show the corresponding parameter 
regions using the green bands in Fig.[2j The green (light green) band width corresponds 
to the lcr (2cr) error quoted in Eq. ( |28| ). As seen in the plot, even with maximal mixing 
| sin p T \ ~ 1 we required a ~ 0.6. 

This model predicts the same helicity structure as in the top sector discussed in the 
previous section, that is, decaying Higgs provides left-handed r~ in h —» t~ p + decay. We 
can confirm it by observing the energy fraction carried by the visible decay products of the 
r. For the left-handed r decay the visible energy fraction distribution is expected softer pa 
[5E| . The fact that full event kinematics reconstruction is possible in this process makes the 
analysis straightforward. 

Finally, we comment on the related lepton flavor-violating decay: r —y p'y. It is found 
that, as also discussed in Ref. the decay rate of r —* py is well below the present 
experimental upper bound in the parameter region for explaining the h —y rp events. 


VI. CONCLUSION 

In this work, we have studied the top-specific variant axion model and the phenomenology 
related to the flavor-changing Yukawa couplings of the top quark. This model is well- 
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motivated to solve the strong CP domain wall problem. Only the right-handed top quark 
held is charged under the Peccei-Quinn (PQ) symmetry. Two Higgs doublet helds are 
required for consistency and one of them also carries a nonzero PQ charge. Compared with 
the usual two-Higgs doublet models, this model has additional flavor mixing parameters. We 
investigated in detail the scenario with top-charm mixing, governed by a mixing parameter 
p, leading to modifications of Yukawa couplings and predicting the t —» he decay. We 
constrained the model parameter space using the current Higgs data on signal strengths of 
different channels and bounds on the branching ratio of t —> he decay. While the decoupling 
limit is favored by the data, a small parameter space with the wrong sign in bottom Yukawa 
coupling still cannot be ruled out at the moment. Moreover, we found that a large portion 
of the allowed parameter space will be covered by the t —> he search at LHC Run-11. 

The hclicity structure in the flavor-changing top Yukawa coupling is a specific feature of 
the model. The coupling between the left-handed top and the right-handed charm is stronger 
than that in the other chirality combination. We illustrated that this property could be 
measured in the decay distribution of spin-correlated top pair production once a sufficient 
number of signal events are collected. We also note that the sensitivity assumed here is 
conservative and further improvement in the sensitivity of the t —> he decay measurement 
at the LHC would be possible and very important. 

We have also considered the scenario where the right-handed r lepton also carries a 
nonzero PQ charge, as the right-handed top quark, and couples to the PQ-charged Higgs 
boson. In this case, we also expect to have the h —>■ r/i decay. Interestingly, the parameter 
region allowed by the Higgs signal strength data was slightly enlarged. We showed that the 
parameter regions required by the anomalous h -y t/j branching ratio reported by the CMS 
Collaboration had parts consistent with the above-mentioned constraints. The overlapped 
regions were marginal to the bounds on BR (t —> he) and well within the reach of the future 
LHC sensitivity. If so, we would expect the t —>• he signal to be soon observed at the LHC 
Run-II. By measuring the tau polarization in the flavor-changing Higgs decay, we could also 
probe the specific hclicity structure in the lepton Yukawa couplings of the model. 
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